DOCUMENT RESUME 

JC 860 070 

Nespoli, Lawrence A. 

The Improvement of Occupational Education in 
Maryland* A Progress Report, Fiscal Year 1985. 
Maryland State Board for Community Colleges, 
Annapolis* 

Maryland State Dept. of Education, Baltimore* Div. of 
Vocational-Technical Education. 
Feb 86 

23p.; For an earlier report, see ED 241 086. 
Reports - Evaluative/Feasibility (142) 

MF01/PC01 Plus Postage. 

^Community Colleges; ^Databases; Data Collection; 
*Management Information Systems; Program Development; 
♦Program Evaluation; State Surveys; Two Year 
Colleges; ^Vocational Education 
♦Maryland 



A series of projects were conducted in Maryland as 
part of an effort to develop a valid and reliable student database 
for planning, decision making, and Vocational Education Data System 
reporting; and a systematic and objective procedure to evaluate the 
quality of occupational programs in Maryland's community colleges. 
The projects had three objectives: (1) to conduct statewide studies 
related to credit enrollment, degree recipients, graduate follow-up, 
leaver (entrant) follow-up, employer follow-up, discipline cost 
analysis, the continuing education data system, and program 
inventory; (2) to run the State Board's Program Data Monitoring 
System and review each of the career programs by June 15, 1985; and 
(3) to publish an in-depth evaluation of 50 community college 
programs and a statewide evaluation of two-year engineering programs 
by March 15, 1985. The project report provides a brief overview of 
procedures and results for each of the objectives. In addition, data 
are presented on the number and percentage of programs evaluated and 
discontinued between 1978 and 1984 by program area; programs 
designated for qualitative evaluation in 1985 are listed; and guides 
for using the Program Data Monitoring System and for using 
information to support instructional program evaluation are appended. 
(EJV) 
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Resolution 



ESTABLISHMENT OF JOINT COORDINATING COMMITTEE 
FOR OCCUPATIONAL EDUCATION PROGRAMS 
MARYLAND STATE BOARD OF EDUCATION - 
MARYLAND STATE BOARD FOR COMMUNITY COLLEGES 



WHEREAS, The Maryland State Board for Community Colleges and the Maryland 
State Board of Education, in order to improve, expand, and coordinate 
their individual and joint efforts in the development, achievement, and 
support of high-quality occupational programs and services in post- 
secondary education for the citizens of Maryland; and 

WHEREAS, A joint commitment of these two agencies to regular and systematic 
cooperation and coordination will assure the achievement of certain key 
objectives; 



NOW, THEREFORE, BE IT RESOLVED That the State Board for Community 
Colleges and the Maryland State Board of Education will link efforts to 
achieve the following objectives: 

I. Coordinate staff efforts through active dialogue and information- 
sharing concerning curriculum, facilities, personnel development, 
fiscal matters, and appropriate technical assistance in the occupa- 
tional area; 



2. Coordinate appropriate interrelated informational components within 
information systems; 

3, Systematic sharing of relevant communication pertaining to specific 
occupational projects undertaken by community colleges; 

ft. Jointly develop, publish, and disseminate informational program 
material:: and brochures highlighting occupational programs in Mary- 
land community colleges; 

5. Establish a joint coordinating committee for occupational education 
to foster interagency planning on annual and long-range master 
planning. 



Approved: 

State Board of Education, April 28, 1976 

State Board for Community Colleges, May 13, 1976 
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PROJECT SUMMARY 
FISCAL YEAR 1985 



P ROJECT TITLE 

Management Information System and Program Evaluation, Activity No. 4.2.6 
PROBLEM 

A valid and reliable student data base is needed for planning, decision making, and 
Vocational Education Data System (VEDS) reporting. A systematic and objective 
procedure is needed to evaluate the c^ality of occupational programs in Maryland 
community colleges. 

OBJECTIVE NO. I 

To conduct the following statewide projects, including the preparation of com- 
puter files and publication of a report for each study: 

Credit enrollment 
Degree recipients 
Graduate follow-up 
Leaver (entrant) follow-up 
Employer follow-up 
Discipline cost analysis 
Continuing education data system 
Program Inventory 

PROCEDURES AND RESULTS 

Credit Enrollment. Opening Fall enrollment is reported using a system of 
computer tapes trom the colleges. In addition to demographic data about each student, 
the student's program of study and credit hours carried are reported. All seventeen 
community colleges submitted tapes or coding forms in Fall 1984. Data were published 
in the State Board for Community Colleges (SBCC) State Plan for Community Colleges 
and in the Databook. 

Certificates and Degrees Awarded. The number of students who complete 
programs during the fiscal year are reported by college by program. Trends in the mix 
of occupational and transfer degrees are analyzed. Colleges submit the degree data on 
computer tapes or coding forms with one record per graduate. A report on character- 
istics of community college graduates was presented in the SBCC Bulletin. Degree 
trends were analyzed in Databook. 

Graduate Follow Up. The statewide graduate follow-up study surveys persons 
about nine months after program completion. The study is a joint project of the 
community colleges and the State Board for Community Colleges and uses a standard 
questionnaire mailed in odd-numbered years. In FY 1985, 8,219 graduates from 1984 
were surveyed and an adjusted response rate of 50 percent was achieved. Each college 
has received a printout of its data, a statewide aggregation, nnd an aggregation of the 
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responses of graduates from similar peer colleges. Crosstabulation by program was 
provided to each college. A report of the 1984 graduates will be sent to the Division of 
Vocational-Technical Education as soon as it is completed. 

Leaver Follow-Up . The statewide entrant foliow-up study surveys persons two to 
four years atter entr/ to the community college. The study uses a standard 
questionnaire mailed out in even-numbered years. All first-time entrants from 1982 
were surveyed in FY 1984, and an adjusted response rate of 37 percent was achieved. 
The results have been tabulated by the State Board for the seventeen community 
colleges, and a final report will be shared with DVTE as soon as it is completed. 

Employer Follow-Up. The statewide employer follow-up study surveys the 
employers of graduates who (I) completed an occupational program, (2) are employed 
full-time, (3) are in work related to their education, and (4) gave permission to contact 
their employer. The study is a joint project of the community colleges and the State 
Board for Community Colleges and uses a standard questionnaire mailed out in odd- 
numbered years. Specific questions retired by the VEDS ere included in the survey. In 
FY 1985, employers of the 1984 community college graduates were surveyed and a 
response rate of 60 percent was achieved. Each college received printouts of its data, 
statewide results, and comparisons with previous employer surveys. A report utilizing 
the data from this employer survey and comparing the data with previous surveys is 
being prepared and will be sent to the Division of Vocational-Technical Education whe , 
it is completed. 

Discipline Cost Analysis. Costs and full-time equivalent students are reported for 
each discipline at each college. The data enable an analysis of trends in costs per FTE 
student in occupational disciplines. Colleges are provided with trend reports for their 
college, similar size colleges, and statewide. A Discipline Cost Analysis Manual has 
been developed and is revised periodically to clarify the procedures for preparing the 
cost data. Colleges report the data to SBCC on a standard format tape in order to 
facilitate processing and accuracy of the data. 

Continuing Education Data System. Enrollments and contact hours are reported 
to the State Board for Community Colleges for each approved noncredit course. 
Keports are generated showing the number of registrants and full-time equivalent 
students in specific types of occupational courses at eacK college. Copies of these 
reports are sent to the colleges and to the DVTE at the end of each year. Summary 
reports of enrollments in noncredit courses are included in the annual State Board 
Databook. 

The State Board for Community Colleges has implemented a computerized system 
for colleges to submit enrollment, course, and student demographic data in continuing 
education. This tape system provides software that generates a standard format file 
and produces management and aid transmittal reports at each college. The software 
was used by all colleges in FY 1985 to produce State reports and to produce an end-of- 
year data tape for the SBCC. 

Program Inventory. The SBCC Program Inventory was updated in FY 1985 to 
reflect programs that were added, discontinued, or made inactive. The Program 
Inventory is the backbone of the SBCC Information System and is critical to the 
Program Data Monitoring System and to student follow-up studies. A crosswalk is used 
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for the new federal Classification of Instructional Programs (CIP). Colleges will 
continue to report their enrollment, degrees, discipline cost analysis, employee data, 
and follow-up surveys using the present six-digit State Board for Community Colleges 
and te Board for Higher Education subject codes. The SBCC and SBHE translate 
these program codes to CIP codes for any federal report which requires CIP codes. 

Common Data Elements. In a statewide system of locally governed community 
colleges, each institution is free to develop its own data processing system. In order to 
insure that data from each institution are comparable and to promote more efficient 
development of data systems, the Association of Data Processing Directors of Maryland 
Community Colleges has produced the Course Master Data Elements and Student Data 
Element Dictionary. This Data Element Dictionary has been continuously updated by 
the data processing directors and maintained by the State Board for Community 
Colleges on the SBCC computer file. In FY 1985, a section on course master file data 
elements was added to the dictionary. 

OBJECTIVES NO. 2 AND NO. 3 

To run the State Board tor Community Colleges Program Data Monitoring System 
and review each of the career pt caroms by June 15, 1985. (See Appendix A for a 
description of the SBCC PDM System.) 

To publish an in-depth evaluation of fifty community college programs by 
March 15, 1985 and a statewide evaluation of two-year engineering programs. (See 
Appendix B f or a description of the SBCC Program Evaluation System.) 

PROCEDURES AND RESULTS 

Program Data Monitoring System. The 1985 printout of the Program Data 
Monitoring System was sent to college occupational deans and institutional researchers 
for confirmation of the data. Upon receipt of the corrections, a final printout was 
made and a copy was sent to the DVTE with one page per program at each college. 

Enhancements are made to the PDM System every year. This year data were 
added about Fall 1984 enrollment, FY 1984 awards, and FY 1984 discipline costs. The 
1984 Higher Education Cost Index was included in the Discipline Cost Analysis display 
of cost trends and the results for the 1982 graduates were added to the display of 
follow-up surveys. 

Program Evaluation. The system for program evaluation is described at length in 
the Instructional Program Manual. Briefly, the SBCC reviews each program at each 
college every April using the Program Data Monitoring System. The PDM System 
displays trends in enrollments, awards, employment in field of training, student satis- 
faction, discipline costs, and job openings. Programs that appear to need a qualitative 
evaluation are identified und a letter asking specific questions is sent to the college 
presidents. The colleges prepare written responses, and the responses are compiled into 
a Program Evaluation Report reviewed by the State Board for Community Colleges in 
January. 

The 171-page Program Evaluation Report was published in April 1985 and sent to 
the DVTE. After the seventh full cycle of program evaluations, 328 programs have 
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been evaluated. Many programs have been improved through changes in curriculum, 
staffing, or recruitment. In addition, 75 programs have been discontinued and thirteen 
are currently inactive. Table I shows the number of programs evaluated by year and by 
occupational program area. 

In June 1985, 53 programs were identified for a c^alitative evaluation in the 
eighth cycle of the Program Evaluation System to be conducted in FY 1986. Table 2 
gives the names of the programs identified for a college evaluation and the primary 
reason(s) for the evaluation request. 
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Table I 



PROGRAM EVALUATION SYSTEM 
MARYLAND COMMUNITY COLLEGES 
FISCAL YEARS 1978- 1984 



Number Total Programs 

of Active Programs Designated for Eva l uation 1978 - Discontinued 
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Table 2 



PROGRAMS DESIGNATED FOR QUALITATIVE EVALUATION 
MARYLAND COMMUNITY COLLEGES 
1985 



COLLEGE 
Program 



Issue 



ALLEGANY 
Business Administration Transfer 

Data Processing Technology 



Forest Technology 



\NNE ARUNDEL 
Office Technology 

Communication Arts Technology 



Data Processing 



BALTIMORE 
General Studies 



Fashion Design 



Business Data Processing 



Dental Assisting 



Electronics Technology 



Public Sector Administration 



Low transfer performance 

Declining enrollment 
Statewide evaluation 

Declining enrollment 
Low placement 
High cost 

Previous evaluations in 1978 & 1981 



Low placement 
High cost 

Previous evaluations in 1979 & 1982 

Declining enrollment 
Statewide evaluation 



Declining enrollment 
Low transfer perfcrmunct. 
Previous evaluation in 1979 

Declining enrollment 
Low awards 
Low placement 

Declining enrollment 
Low awards 

Previous evaluation in 1981 

Declining enrollment 
Low awards 
Inadequate follow-up 
High cost 

Previous evaluation in 1979 

Declining enrollment 
Low placement 

Low enrollment 
Low awards 
-6- 



HEGIS No. 

4970-01 
5101-01 

5403-01 



5005-01 
5008-01 

5101-01 

4950-01 

5012-12 

5103-01 

5202-01 



5310-01 
5508-01 
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CATONSVILLE 
Computer Studies/Data Processing 

Mental Health Services 



Civil Engineering Technology 
Recreation, Parks, & Leisure Studies 



CECIL 
Arts & Sciences Transfer 



Data Processing 

CHARLES 
Office Technology 



Data Processing 



Licensed Practical Nursing 



CHESAPEAKE 
Business Administration Transfer 



Computer Studies 

DUN DAL K 
Computer Programming Technology 

Retail Floristry 
Labor Studies 



Declining enrollment 5103-01 
Statewide evaluation 

Declining enrollment 5216-01 
Inadequate follow-up 
High cost 

Previous evaluations in 1978 & 1981 

Low awards 5309-01 

Declining enrollment 5506-01 
Inadequate fo^ low-up 
Previous evaluation in 1981 



Low awards 4910-01 
Inadequate follow-up 
Previous evaluation in 1981 

Declining enrollment 5101-01 
Statewide evaluation 



Declining enrollment 5005-01 
Declining awards 
Low placement 

Declining enrollment 5103-01 
High cost 

Statewide evaluation 

Declining enrollment 5209-01 
Declining awards 
Inadequate follow-up 
Previous evaluation in 1982 



Declining enrollment 4970-01 
Inadequate follow-up 

Declining enrollment 5103-01 
Statewide evaluation 



Declining enrollment 5103-01 
Statewide evaluation 

Declining enrollment 5'>02-02 

Declining enrollment 5599-04 
inadequate follow-up 
High cost 

Previous evaluation in 1981 
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ESSEX 
Data Processing 



Computer Technology 

Medical Laboratory Technology 
Mental Health 



FREDERICK 
Data Processing 



Dental Assisting 



Park Management 



GARRETT 
Arts & Sciences Trans f er 



Coal Mining Technology 



HAGERSTOWN 
Data Processing 



Hospitality 

HARFORD 
Business Management 

Data Processing 

Nursing 



Declining enrollment 5103-01 
Statewide evaluation 

Declining enrollment 5105-01 
Inadequate follow-up 

Declining enrollment 5205-01 

Declining enrollment 521 6-01 

Declining awards 
Low placement 
High cost 

Previous evaluations in 1978 & 1982 



Declining enrollment 51 0 i —0 1 

Statewide evaluation 

Declining enrollment 5202-01 
Inadequate follow-up 
Hicfi cost 

Previous evaluation in 1982 

Inadequate follow-up 5506-02 
Previous evaluation in 1981 



Declining enrollment 4910-01 
Declining awards 

Low enrollment 5399-03 
Low awards 
Inadequate follow-up 
Previous evaluation in 1982 



Declining enrollment 5101-01 
Low placement 
Statewide evaluation 

Declining enrollment 5404-01 
inadequate follow-up 



Declining enrollment 5001-01 
Inadequate follow-up 

Declining enrollment 5101-01 
Statewide evaluation 

Declining enrollment 5208-01 
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HOWARD 
Accounting 



Housing Management 



Residential Construction 



MONTGOMERY 
Business Adminislration Transfer 



Computer Science & Technology 



Computer Operator 



Mental Health Associate 



PRINCE GEORGE'S 
Office Technology 

Data Processing 



Radiologic Technology 



WOR-WIC TECH 
General Studies 



Data Processing 
Automotive Technology 



Declining enrollment 5002-01 
Low placement 

Low enrollment 5004-03 

Low awards 

Inadequate follow-up 

Previous evaluations in 1978 & 1981 

Inadequate follow-up 531 7-03 

High cost 



Low awards 4970-0 1 

Low transfer performance 

Declining enrollment 5103-01 
Low placement 
Statewide evaluation 

Declining enrollment 5104-01 
Low placement 

Declining enrollment 5216-01 

Low plccement 

Previous evaluation in 1981 



Declining enrollment 5005-01 

Declining enrollment 5101-01 
Statewide evaluation 

Declining enrollment 5207-01 
High cost 



Low awards 4950-0 1 
Inadequate follow-up 
Previous evaluation in 1980 

Statewide evaluation 5103-01 

Low enrollment 5306-01 
High cost 

Previous evaluation in 1982 
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Appendix A 

A GUIDE FOR USERS OF THE PROGRAM DATA MONITORING SYSTEM 



The State Board for Community Colleges Program Evaluation System was 
developed in cooperation with the community college presidents and approved by the 
Board in 1978. The system involves two steps: quantitative evaluation of each program 
each year by the SBCC, and qualitative evaluation of selected programs each year by 
the community colleges. The following information is given to assist in the interpreta- 
tion of data on the Program Data Monitoring (PDM) printout: a display of enrollment, 
awards, follow-up, discipline cost, and manpower information. 

Program Number and College Program Title* These items are taken from the current 
SBCC Program Inventory. Data are only shown on the PDM printout as related to 
programs and not according to program options. Data related to program options are 
included as part of the overall program. For example, a college may have a program in 
Electronics Technology, with an option in Digital Electronics. Data related to the 
Digital Electronics option are included in the data with Electronics Technology. 

Enrollment and Awards. Enrollment and awards data are obtained from Enrollment 
Information System (EIS) data tapes and from the Degree Data System tapes, 
respectively. The "FT ENR-TO-AWARD RATIO" is derived by taking one-half of the 
full-time enrollment in a given year and dividing that figure by the number of graduates 
two years later. For example, a program that had 100 full-time students in 1978 and 
twenty-five graduates in 1980 would have a ratio of 2:1. All student and discipline cost 
ir formation on the PDM printout is submitted by the colleges, and changes are not 
made in that data without consulting the college. 

Similar Programs. Enrollment and award data from the most recent year are shown for 
each college having the same program in order to show the scope of the programs at 
adjacent colleges and statewide. 

Student Fol low-Up Studies. Student follow-up studies are conducted jointly by the 
college and the State Board, with the college responsit'e for mailing the questionnaires 
to students. The column 1980 Graduates refers to a study of r' 1 graduates of FY 1980, 
surveyed in Spring 1981. The statewide response rate among graduates actually 
receiving the qjestionnaire was 65 percent. The column 1982 Graduates refers to a 
similar survey conducted in 1983, with a response rate of 61 percent. All percentages 
in the follow-up section are simple percentages of the number of respondents, except 
the data "Among Full-time Employees" where blanks have been excluded from the 
denominator to arrive ct the percentage. Graduate follow-up data are generally not 
interpreted when there are less than ten respondents. However, since the question- 
naires were identical in both follow-up studies, the results from the two studies can be 
combined, if necessary, to get a more reliable picture of the graduates. 

Annual Openings, 1976-1982. The data were developed by the Maryland Department of 
Human Resources, Research and Analysis Di vision, and published os the Occupotionol- 
-Industrial Outlook- 1982, March 1980. A similar publication was used for the Baltimore 
area data, which inHudes Baltimore City and the following counties: Harford, Balti- 
more, Carroll, Howard, and Anne Arundel. The methodology for projecting job openings 
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involves using data from the Occupational Employment Statistics (OES) Program 
Occupational information is based upon employer responses solicited every three years. 
The projections include openings due to growth and labor force separations. 

Discipline Credit Hour Cost. Data are shown as reported in the SBCC Discipline Cost 
Analysis tor the fiscal years shown. Basically, the discipline cost analysis accounts for 
inftlKHft^V* + 6 co,, ( ^» including federal) and attributes them to direct costs, 
additional direct costs, and indirect costs. Direct costs are a function of the faculty 
compensation and class size. Additional direct costs include supplies and materials 
related to the teaching of that discipline, such as laboratory supplies. Indirect costs 
include general administration costs, including the library, student services, and 
utilities. Indirect costs are applied to all courses in proportion to the number of full- 
time equivalent students in the course. Cost data are shown for each discipline at a 
college and compared to the cost of that discipline statewide; costs are also shown for 
all disciplines at a college and compared to the cost of all disciplines statewide. 

Procedure for Program Evaluation. Every April, the updated PDM printout Is 
distributed to academic d^ans, occupational deans, and institutional research directors 
to verify the data. The SBCC staff then identifies several programs at each college 
that appear to be n; some difficulty and in need of a qualitative evaluation. In general 
selection is based upon enrollment, awards, and job placement, in that order. Discipline 
cost information is used 10 the context of the overall discipline cost at the college and 
the a/erage cost of the discipline at other colleges. 

The selection of programs for a qualitative evaluation is assisted by "flaqs" shown in the 
lower right corner of Ine PDM printout. The flags represent criteria checks on certain 
data, such as 'Enrollment decreased at least 20 percent and by ten students last year " 
The flags were set with the help of community college academic deans, occupational 
deans, and institutional research directors. The flags are used by the SBCC staff to 
assist in selecting programs for a qualitative evaluation but are not the sole criteria for 
requesting a qualitative evaluation by the college. 

The SBCC staff constructs questions to be addressed in the qualitative evaluation. 
Upon approval by the State Board for Community Colleges in June, the questions are 
sent to each college president. Colleges conduct the qualitative evaluations, respond to 
the questions raised, and submit a report to the SBCC. The SBCC publishes a report of 
a 1 questions and responses. The report is distributed to the community colleges, to the 
State Eoard for Higher Education, to the State Department of Education, Division of 
Vocational-Technical Education, and to the Maryland State Council for Vocational- 
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08/23/85 SBCC PROGRAM DATA MONITORING SYSTEM 

COLLEGE: HARFORD COMMUNITY COLLEGE 



BEST COPY AVAILABLE 



PAGE 367 



COLLEGE PROGRAM TITLE 



YEAR 
IMPLEMENTED 



PROGRAM NUMBER : 5?08 01 

HEGIS PROGRAM CATEGORY: NURSING, RN 



CERTIFICATE: NOT OFFERED 
ASSOCIATE: NURSING 



PRE 1974 



CURRENT 
STATUS 



ACTIVE, 



USOE 
DUMBER 



7030100 



FALL ENKOLLntNl: 


1979 
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4 n o T 
1 93 3 
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FALL | 


1984 


AWARDS 




S CH YR 


FULL-TIME 
PART-TIME 
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1 COLLEGE 


FT 


PT 


TOTAL 


CERT 


AA 


TOTAL 


ASSOCIATE LEVEL 






- 

























FULL-TIME 


176 


198 


145 


130 


121 




65 


ALLEGANY 


203 


159 


362 




70 


70 


PART-T IME 


244 


330 


330 


397 


39 5 




342 


I ANNE ARUNLtL 


63 


473 


536 




74 


74 


TOTAL HEAD-COUNT 


420 


528 


475 


527 


516 




407 


I BALTIMORE 


101 


172 


273 




6' 


64 


















I CATONSVILLE 


?81 


662 


943 




106 


106 


AWARDS : 
















I CECIL 


51 


99 


150 




22 


22 


CERTIFICATES 
















I CHARLES 


60 


24 


84 




33 


33 


ASSOCIATE DFGREES 


72 


7? 


98 




71 




86 


I ESSEX 


155 


492 


647 




106 


106 


TOTfL ALL AWARDS 


72 


7 n 


98 


if 


71 




86 


I FREDERICK 


47 


112 


159 




39 


39 


















I H AG E R S TOWN 


31 


34 


65 




25 


25 


PERCENT FULL-TIME 




38Z 


31X 


25Z 


23Z 




165: 


I HARFORD 


65 


342 


407 




86 


86 


















I HOWARD 


54 


311 


365 




81 


81 


FT ENR-TO-AUARD RATIO 






1st 


1:1 


1:1 




1:1 


I MONTGOMERY 


46 


157 


203 




80 


SO 


STATEWIDE FULL-TIME ENROLLMENT 


-TO-AWAR D 


RAT 10 








1 :1 


I PRINCE GEORGE'S 


Z31 


534 


? n 




116 


116 


(RATIO = 1/2 FT ENROLLMENT DIVIDED BY 


AWARDS 


2 YEARS LATER) 




[ WOR-WIC TECH 


19 


29 






34 


3* 


















TOTAL ALL COLLEGES 


1407 


3600 


5007 




936 


936 



STUDENT FOLLOW-UP STUDIES: 



1980 
GRADUATES 

COLLEGE STATE 



19&2 
GRADUATES 



NUMBER OF RESPONDENTS 28 

RESPONSE RATE 39Z 

FULL-TIME JOB, DIRECTLY RFLATED 50Z 

FULL-TIME JOB* SOMEWHAT RELMED 7Z 

FULL-TIME JOb, NOT RELATED OZ 

PART-TIME JOB 32Z 

TRANSFERRED, N0 T EMPLOYED 4Z 

SEEKING WORK , NO i EMPLOYED 4Z 

MILITARY, HOME RESPON, OTHEP 4Z 

TOTAL 100Z 

TRANSFERRED, PEGARDLESS OF f M PL 32Z 

ACHIEVED PERSONAL GOAL 93Z 

SATISFIED WITH INSTP IN PROGRAM 100Z 



388 



611 
3Z 
1Z 

27Z 
IX 
2X 
51 

100Z 

12X 
96Z 
94X 



COLLEGE 

38 
43Z 

79Z 
OZ 
OZ 

16Z 
OZ 

100Z 

13Z 
95Z 
95Z 



STATE 
415 



iz 
aiz 

u 

4Z 

100Z 

10Z 
98Z 
95 Z 



AMONG FULL-TIME EMPLOYEES 

MEDIAN ANNUAL SALARY S14.02? $14,326 

MO. REPORTING SALARY DATA 15 217 

B cG AN NEW JOB AFTER COLLEGE 94X 85Z 

SATISFIED WITH FMPLMNT PREP 100Z 93X 



SI616OC 516,640 
24 270 
69Z 85Z 
93* 9SZ 



ANNUAL JOB OPENINGS, 1976-1982: 
NURSES, PROFESSIONAL 



BALT AREA STATEWIDE 
975 1,438 



DISCIPLINE CREDIT HOUR 


COST IN 


NURSING , 


RN 








Frai 


FY82 


FY83 


FY84 


81-84 


HIGHER ED PRICE INDEX 


~203 


~?26 


240 


253 


♦ 25* 


STATEWIDE COST: 








i!01 




ALL DISCIPLINES 


183 


S87 


594 


♦ 22X 


THIS DISCIPLINE 


1133 


5145 


$152 


5160 


♦ 20* 


COLLEGE COS*"-: 










♦ 33: 


ALL DISC IPLINES 


5 84 


181 


S106 


\ii2 


THIS DISCIPLINE 


587 


5105 


5H6 


SI 30 


♦ 49Z 



THESE COSTS ARE DISCIPLINE COSTS, NOT PROGRAM COSTS; 
A SINGLE DISCIPLINE MAY SUPPORT SEVERAL PROGRAMS. 



P DM QUANTITATIVE CRITERIA CHECKS INDICATE: 

ENROLLMENT DECREASED AT LEAST 10* AND BY 10 STUOENTS LAST Y£W( 



JOB OPENINGS MAY ALSO BE AVAILABLE IN OTHER OCCUPATIONS- SEE 
DHR MANPOWER PROJECTIONS. SOME STUDENTS ARE ALREADY EMPLOYED 
WHILE ATTENDING THE COMMUNITY COLLEGE. THEREFORE, OPENINGS MAY 
NOT BE NEEDED FOR ALL GRADUATES. OPENINGS AH E FOR MARYLAND ONLY. 



SOURCES: HEGIS REPORTS, FOLLOW-UP STUDIES, DEPT OF HUMAN RESOURCES "OCCUPA I DNAL-INDUSTRI AL OUTLOOK" AND DISCIPLINE COST ANALYSIS 
DATA ARE SUB J ECT TO CONFIRMATION BY THE COLLEGE. O 



Appendix B 

USING INFORMATION TO SUPPORT INSTRUCTIONAL PROGRAM EVALUATION 



Program evaluation in Maryland community colleges is part of an integrated system 
for program implementation and evaluation, with both pieces woven together by an 
extensive data base. The ~rocess for implementing and evaluating instructional programs in 
Maryland community colleges is diagrammed on the following page. New programs begin 
with local needs. Faculty members and administrators see educational needs among 
students and employers and respond with program ideas. By December, the college submits 
the titles for its proposed programs to the State Board for Community Colleges (SBCC) and 
the titles are printed in the State Plan for Community Colleges in Maryland. In June, the 
college submits Letters of Intent that describe the goals and nature of the proposed 
programs. The SBCC acts on the Letters of Intent at its July meeting, raising questions as 
necessary and making suggestions for program development. Often the questions arise from 
the Program Data Monitoring System. For example, a college could propose a new program 
in recreation technology; statewide data about employment of graduates of existing 
recreation programs may indicate that a new program would have great difficulty with job 
placement. 

In November, the colleqes submit full program proposals. The proposals are analyzed 
by the SBCC staff with an eye toward employment possibilities, student interest, and cost. 
Again, the Program Data Monitoring System is used to establish benchmarks for reasonable 
projections in the proposals. The SBCC acts on the program proposals at the December 
meeting. Following SBCC action, the programs are sent to the State Board for Higher 
Education (SBHE) for approval. The Division of Vocational-Technical Education (DVTE) of 
the Maryland State Board of Education also reviews the proposals for federal funding. 
Approved programs are generally implemented the following September, about fifteen 
months after the Letter of Intent was submitted. 

Program evaluation is a two-step process in Maryland community colleges. The first 
step is a quantitative evaluation. Each April the SBCC staff evaluates each program at 
each college using the Program Data Monitoring System. The PDM System produces one 
computer page for each program and displays trends in enrollment, degrees, and discipline 
costs. Employment and transfer information from entrant and graduate follow-up is also 
shown. The printout is sent to the colleges for verification in May. 

In June, the SBCC requests colleges to conduct a qualitative evaluation, the second 
step in the process. Typically, the local qualitative evaluation is done with a committee of 
faculty, academic administrators, and institutional research staff members. The committee 
dr aws on their experiences, conducts a deeper analysis of existing data, and seeks more 
information from students or employers. The qualitative evaluations are reviewed and 
compiled by the SBCC and distributed to the SBHE and DVTE. The most recent Program 
Evaluation Report was 171 pages in length and included the questions asked by the SBCC and 
the college responses to each question. Engineering Transfer programs were evaluated at 
each college statewide during the last year, and the Program Evaluation Report contains a 
summary of the statewide evaluation. During the first seven complete cycles of the 
evaluation system, 328 programs were evaluated. Many programs were improved through 
changes in their curriculum, staffing, recruiting, and retention. Seventy-five programs were 
discontinued; thirteen are currently inactive. 
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Maryland State Board for Community Colleges 
PROGRAM IMPLEMENTATION AND EVALUATION 



Local 
Needs 




Program 
Title in 
State Plan 


— 9> 



Letter of 
Intent 



Proposal to 
SBCC 

— TT 1 


— ft 


1 

Proposal to 
SBHE S DVTE 




Program 
Implemented 




1 



DATA 

Enrol Iment 

Degrees and Certificates 
Entrant Follow-up 
Graduate Follow-up 
Di sclpl ine Costs 
Manpower (job openings) 



Program Data 
Monitoring 
System: 
Quanti tat ive 
Evaluation of 
Each Program 



Qua! I tat Ive 
Evaluation 
by Col lege 



SBCC * State Board for 
SBHE = State Board for 

DVTE 0 S Divlslon of Vocations I -Technical Education 
-Maryland State Department of Education 



Community Col leges 
Higher Education 
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ERIC 



Report 
SBCC 



to 



1 



Report 
SBHE & 



to 

DVTE 



Possible 
Program Act ions; 
Modify 

Make Inact i ve 
Di scont inue 



